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Abstract. We extend the second Noether theorem to optimal control prob- 
lems which are invariant under symmetries depending upon k arbitrary func- 
tions of the independent variable and their derivatives up to some order m. 
As far as we consider a semi-invariance notion, and the transformation group 
may also depend on the control variables, the result is new even in the classical 
context of the calculus of variations. 



1. Introduction 
The study of invariant variational problems 

Minimize J [a;(-)] = f L(t, x(t),x(t)) dt 

J a 

in the calculus of variations was initiated in the early part of the XX century by 
Emmy Noether who, influenced by the works of Klein and Lie on the transforma- 
tion properties of differential equations under continuous groups of transformations 
(see e.g. [2, Ch. 2]), published in her seminal paper [13, 14] of 1918 two fundamen- 
tal theorems, now classical results and known as the (first) Noether theorem and 
the second Noether theorem, showing that invariance with respect to a group of 
transformations of the variables t and x implies the existence of certain conserved 
quantities. These results, also known as Noether's symmetry theorems, have pro- 
found implications in all physical theories, explaining the correspondence between 
symmetries of the systems (between the group of transformations acting on the 
independent and dependent variables of the system) and the existence of conser- 
vation laws. This remarkable interaction between the concept of invariance in the 
calculus of variations and the existence of first integrals (Noether currents) was 
clearly recognized by Hilbcrt [6] (cf. [12]). 

The first Noether theorem establishes the existence of p first integrals of the 
Euler-Lagrange differential equations when the Lagrangian L is invariant under a 
group of transformations containing p parameters. This means that the invari- 
ance hypothesis leads to quantities which are constant along the Euler-Lagrange 
extremals. Extensions for the Pontryagin extremals of optimal control problems 
are available in [19, 21, 20]. 

The second Noether theorem establishes the existence of k (m + 1) first integrals 
when the Lagrangian is invariant under an infinite continuous group of transforma- 
tions which, rather than dependence on parameters, as in the first theorem, depend 
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upon k arbitrary functions and their derivatives up to order m. This second the- 
orem is not as well known as the first. It has, however, some rather interesting 
implications. If for example one considers the functional of the basic problem of 
the calculus of variations in the autonomous case, 



the classical Wcierstrass necessary optimality condition can easily be deduced from 
the fact that the integral (1) is invariant under transformations of the form T = 
t + p(t), X = x(t), for an arbitrary function p(-) (see [11, p. 161]). The second 
Noether theorem is related to: (i) parameter invariant variational problems, i.e., 
problems of the calculus of variations, as in the homogeneous-parametric form, 
which are invariant under arbitrary transformations of the independent variable 
t (see [1, p. 266], [11, Ch. 8], [3, p. 179]); (ii) the singular Lagrangians and the 
constraints in the Hamiltonian formalism, a framework studied by Dirac-Bcrgmann 
(see [4, 5]); (iii) the physics of gauge theories, such as the gauge transformations 
of electrodynamics, electromagnetic field, hydromechanics, and relativity (see [3, 
pp. 186-189], [1 J , p. 160], [10], [17]). For example, if the Lagrangian L represents 
a charged particle interacting with a electromagnetic field, one finds that it is 
invariant under the combined action of the so called gauge transformation of the first 
kind on the charged particle field, and a gauge transformation of the second kind 
on the electromagnetic field. As a result of this invariance it follows, from second 
Noether's theorem, the very important conservation of charge. The invariance 
under gauge transformations is a basic requirement in Yang-Mills field theory, an 
important subject, with many questions for mathematical understanding (cf. [7]). 

To our knowledge, no second Noether type theorem is available for the optimal 
control setting. One such generalization is our concern here. Instead of using 
the original argument [13, 14] of Emmy Noether, which is fairly complicated and 
depends on some deep and conceptually difficult results in the calculus of variations, 
our approach follows, mutatis mutandis, the paper [19], where the first Noether 
theorem is derived almost effortlessly by means of elementary techniques, with a 
simple and direct approach, and it is motivated by the novelties introduced by the 
author in [21]. Even in the classical context (cf. e.g. [10]) and in the simplest 
possible situation, for the basic problem of the calculus of variations, our result 
is new since we consider symmetries of the system which alter the cost functional 
up to an exact differential; we introduce a semi-invariant notion with some weights 
A , . . . , A™ 1 (possible different from zero); and our transformation group may depend 
also on x (the control). Our result hold both in the normal and abnormal cases. 



We consider the optimal control problem in Lagrange form on the compact in- 



(1) 




2. The Optimal Control Problem 



tcrval [a, b] : 




The notation W\ i is used for the class of absolutely continuous functions, while Loo represents 
the class of measurable and essentially bounded functions. 
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The functions L : K x E" x W -> R and 95 : R x M™ x R r -> R" are assumed to be 
C 1 with respect to all variables and the set of admissible values of the control 
parameters is an arbitrary open set of R r . 

Associated to the optimal control problem there is the Pontryagin Hamiltonian 
H : [a, b] x R" x fl x R x (R") T -> R which is defined as 

(2) H(t, x, u, 0o, 0) — 00-^(0 x, u) + ■ <p(t, x, u) . 

A quadruple (x(-), u(-), 0o, 0(0), with admissible (x(-), 0o G Ro ' an d 0(0 G 

([a, b]; R") (0(0 is a covector 1 x n), is called a Pontryagin extremal if the 
following two conditions are satisfied for almost all t 6 [a, 6]: 

The Adjoint System: 

OH 

(3) 0(0 = -— (t, s(t), «(*), 0(0) ; 

The Maximality Condition: 

(4) (i, x(0, u(t),ip , 0(0) = max If (i, u, 0o, 0(0) • 

The Pontryagin extremal is called normal if 0o an d abnormal otherwise. The 
celebrated Pontryagin Maximum Principle asserts that if (x(-), u(-)) is a minimizcr 
of the problem, then there exists a nonzero pair (0 O , 0(0) sucn that ( x (0, u (0, 0o, 0(0) 
is a Pontryagin extremal. Furthermore, the Pontryagin Hamiltonian along the ex- 
tremal is an absolutely continuous function of t, 

H (t, x(t), u(t),ip , 0(0) G Wi,i([o> & ]; R ) , 
and satisfies the equality 
dlf 

(5) (t, x{t),u(t), 0o, 0(0) = (0 z(t), "(0, 0o, 0(0) , 

for almost all t € [a,b], where on the left-hand side we have the total derivative 
with respect to t and on the right-hand side the partial derivative of the Pontryagin 
Hamiltonian with respect to t (cf. [16]. See [18] for some generalizations of this 
fact). 

3. Main Result 

To formulate a second Noether theorem in the optimal control setting, first we 
need to have appropriate notions of invariance and Noether current. We propose 
the following ones. 

Definition 3.1. A function C (t, x, u, 0o, 0) which is constant along every Pon- 
tryagin extremal (x(-), u(-), 0o, 0(0) °f the problem, 

(6) C(t, x(t), u(t), 0o, 0(0) = k, te[a,b], 

for some constant k, will be called a Noether current. The equation (6) is the 
conservation law corresponding to the Noether current C. 

Definition 3.2. Let C m 3 p : [a,b] R fc be an arbitrary function of the indepen- 
dent variable. Using the notation 

a(t) = (t,x(t),u(t),p(t),p(t),---,P (m \t) 

we say that the optimal control problem is semi-invariant if there exists a C 1 
transformation group 

j:[tt,i]xR°x!]x R fe*(m+i) _, r x r« x K '' , 

(7) g(a(t)) = (T(a(t)),X(a(t)),U(a(t))), 
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which for p(t) = p(t) = • ■ ■ = p^> (t) = corresponds to the identity transforma- 
tion, g(t, x, u, 0, 0, . . . , 0) = (t, x, u) for all (t, x, u) £ [a, b] x E" x ft, satisfying the 
equations 

(8) (A • p(t) + A 1 ■ p(t) + ■ ■ • + A™ 1 ■ (<)) ±L (t, x(t),u(t)) 

+ L (t, x(t),u(t)) + ±F («(*)) — L(g («(*))) (a(i)) , 



(9) ±X(a(t))=tp(g(a(t)))±T(a(t)) , 

for some function F of class C 1 and for some A , . . . , A m £ 1 , In this case the 
group of transformations g will be called a gauge symmetry of the optimal control 
problem. 

Remark 3.1. We use the term "gauge symmetry" to emphasize the fact that the 
group of transformations g depend on arbitrary functions. The terminology takes 
origin from gauge invariancc in electromagnetic theory and in Yang-Mills theories, 
but it refers here to a wider class of symmetries. 

Remark 3.2. The identity transformation is a gauge symmetry for any given optimal 
control problem. 

Theorem 3.1 (Second Noether theorem for Optimal Control). If the optimal 
control problem is semi-invariant under a gauge symmetry (7), then there exist 
k (m + 1) Noether currents of the form 



dF(a(t)) 



d P] 



(0 



+ \)L(t,x(t),u(t))) +m 



(') 



dp 



H(t,x(t),u(t),TpoMt)) ° 



(i = 0, . . . ,m, j = 1, . . . , k), where H is the corresponding Pontryagin Hamiltonian 
(2). 

Remark 3.3. We are using the standard convention that p^(t) = p(t), and the 
following notation for the evaluation of a term: 

(*)lo = (*)lp(t)=p(t)=...=p("0(i)=0 ■ 

Remark 3.4. For the basic problem of the calculus of variations, i.e., when (p = u, 
Theorem 3.1 coincides with the classical formulation of the second Noether theorem 
if one puts A 1 = 0, i = 0, . . . , to, and F = in the Definition 3.2, and the transfor- 
mation group g is not allowed to depend on the derivatives of the state variables 
(on the control variables). In §4 we provide an example of the calculus of variations 
for which our result is applicable while previous results are not. 

Proof. Let i S {0, m}, j 6 {1, . . . , k}, and (x(-), u(-), i/jq, tp(')) be an arbitrary 
Pontryagin extremal of the optimal control problem. Since it is assumed that to 
the values p{t) = p(t) = ■ ■ ■ = p^ (t) = it corresponds the identity gauge 
transformation, differentiating (8) and (9) with respect to py and then setting 



p(t) = p{t) = 
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(10) 



3 dt 



d_ dF{a(t)) 
dt 



dp 



(0 



9l 9r (q(t)) 
9t" " 



9L 

du 



dL 

dx 

dU (a(t)) 



dX (q(t)) 



dp 



(') 



L 



d 9T(a(t)) 



dt 



dp 



V) 



d dX(a(t)) 



9</> dT{a(t)) 
9t 



dp) 



(0 



(q(t)) 
" &«: ' 9pf 

9^ dU(a(t)) 
du 



dp 



(<) 



9 



d_ dT (a(t)) 

dt ~ 



9p 



with L and <p, and its partial derivatives, evaluated at (t,x(t),u(t)). Multiplying 
(10) by ipo and (11) by ip(t), we can write: 



00 



dL dT{a{t)) 
dt 



(12) 



dp 



(0 



9X 8X (a(t)) 
9x 



9p} 



(t) 



9L 9C/(a(t)) 
9m 



9p 



(0 



L d_ dT(a{t)) 



dt 



dp 



(>) 



d_ dF(a(t)) 
dt 



dpf 

dp dX(a(t)) 
dx 



3 dt 



dp {l) 

d_ dT (q(t)) 
dt 



dip dU (q(t)) 
dn 



dp 



(i) 



9p 



(0 



d_ 9X(a(t)) 
dt 



9p} 



(0 



According to the maximality condition (4), the function 

4> L (t, x(t), U (a(t))) + ^(f) • <p (t, x(t), U (a(t))) 
attains an extremum for p(t) = p(£) = • • • = p( m >(t) = 0. Therefore 



9L 9t/(a(t)) 



9u 

and (12) simplifies to 
'dL 9T(a(t)) 



dp) 



« 



dip dU (a(t)) 



9 a 



9p} 



(i) 



= 



dt 



dp) 



(<) 



dL dX (q(t)) 
9x 



dp) 



(i) 



d dT(a{t)) 
'dt ~ 



d_ dF(a(t)) 
dl 



dp 



+*(*) • 



dip dT(a(t)) 
dt 



dp 



(0 



9^ 9X (q(t)) 
9a; 



9p 



(i) 



d 9T (q(i)) 



V dt 



o 9 ^ 
d 9X(q(t)) 



dt 



9p) 



(0 



= o. 
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Using the adjoint system (3) and the property (5), one easily concludes that the 
above equality is equivalent to 



d / 8FW)) 



, „• , dX(a(t)) 



dp? 



H dT(a(t)) 



dp? 



o. 



dt y dp f 

Quod erat demonstrandum. □ 

4. Example 

Consider the following simple time-optimal problem with n = r — 1 and £1 = 
(—1,1). Given two points a and (3 in the state space R, we are to choose an 
admissible pair (x(-),u(-)), solution of the the control equation 

x(t) = u(t) , 

and satisfying the boundary conditions a;(0) = a, x(T) = /3, in such a way that the 
time of transfer from a to (3 is minimal: 

T — ► min . 

In this case the Lagrangian is given by L = 1 while ip = u. It is easy to conclude 
that the problem is invariant under the gauge symmetry 

g(t,x{t),u(t),p{t),p(t),p(t)) 

= ( P (t) + t, ( P (t) + l) 2 x(t), 2p{t)x(t) + (p{t) + l)u(i)) , 

i.e., under 

T=p{t) + t, X = {p{t) + lfx{t) , U = 2p(t)x[t) + (p(t) + l)«(t) , 

where p(-) is an arbitrary function of class C 2 ([0, T];R). For that we choose F = 
pit), A = A 1 = A 2 = 0, and conditions (8) and (9) follows: 

L (T, X, U)±T = ± (p(t) + t ) = ±F + L(t, x(t),u(t)) , 
if (T, X, U) = [2p(t)x(t) + (p(t) + 1) u(t)] (p(t) + 1) 



d_ 

From Theorem 3.1 the two non-trivial Noethcr currents 



W) + l?x(t) 



dt 



(13) *k-H, 

(14) 2^(t)x(t), 

are obtained. As far as ipo is a constant, the Noether current (13) is just saying 
that the corresponding Hamiltonian H is constant along the Pontryagin extremals 
of the problem. This is indeed the case, since the problem under consideration is 
autonomous (cf. equality (5)). The Noether current (14) can be understood having 
in mind the maximality condition (4) = <^=> ip(t) = 0). 

5. Concluding Remarks 

In this paper we provide an extension of the second Noether's theorem to the 
optimal control framework. The result seems to be new even for the problems of 
the calculus of variations. 

Theorem 3.1 admits several extensions. It was derived, as in the original work 
by Noether [13, 14], for state variables in an n-dimensional Euclidean space. It can 
be formulated, however, in contexts where the geometry is not Euclidean (these 
extensions can be found, in the classical context, e.g. in [8, 9, 15]). It admits 
also a generalization for optimal control problems which are invariant in a mixed 
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sense, i.e., which are invariant under a group of transformations depending upon p 
parameters and upon k arbitrary functions and their derivatives up to some given 
order. Other possibility is to obtain a more general version of the second Noether 
theorem for optimal control problems which does not admit exact symmetries. For 
example, under an invariance notion up to first-order terms in the functions p(-) and 
its derivatives (cf. the quasi-invariance notion introduced by the author in [20] for 
the first Noether theorem). These and other questions, such as the generalization of 
the first and second Noether type theorems to constrained optimal control problems, 
are under study and will be addressed elsewhere. 

References 

R. Courant and D. Hilbert. Methods of mathematical physics. Vol. I. Intersciencc Publishers, 
Inc., New York, N.Y., 1953. Zbl 0051.28802 MR 16:426a 

A. Duran. Symmetries of differential equations and numerical applications. Universidadc de 
Coimbra, Departamento de Matematica, Coimbra, 1999. Zbl 0967.34001 MR 2001f:35024 
I. M. Gelfand and S. V. Fomin. Calculus of variations. Dover Publications, Mineola, NY, 
2000. Zbl 0964.49001 

X. Gracia and J. M. Pons. Canonical Noether symmetries and commutativity properties for 
gauge systems. J. Math. Phys., 41(11):7333-7351, 2000. Zbl pre01639412 MR 2001k:70023 
M. Guerra. Solucoes generalizadas para problemas L-Q singulares. PhD thesis, Departamento 
dc Matematica, Universidade de Aveiro, 2001. 

D. Hilbert. Grundlagen dcr physik. Math. Ann., 92:258-289, 1924. 

A. Jaffc and E. Witten. Quantum Yang-Mills theory. Problem Description of the Yang-Mills 
Existence and Mass Gap Millennium Prize Problem, The Clay Mathematics Institute of 
Cambridge, Massachusetts (CMI), http://www.claymath.org/prizcproblcms/yang_mills.pdf. 
J. Komorowski. A modern version of the E. Noether's theorems in the calculus of variations. 

I. Studia Math., 29:261-273, 1968. Zbl 0155.17602 MR 37:799 

J. Komorowski. A modern version of the E. Noether's theorems in the calculus of variations. 

II. Studia Math., 32:181-190, 1969. Zbl 0176.41402 MR 39:7485 

J. D. Logan. On variational problems which admit an infinite continuous group. Yokohama 
Math. J., 22:31-42, 1974. Zbl 0295.49023 MR 50:14419 

J. D. Logan. Invariant variational principles. Academic Press [Harcourt Brace Jovanovich 
Publishers], New York, 1977. MR 58:18024 

D. Lovelock and H. Rund. Tensors, differential forms, and variational principles. Wiley- 
Interscience [John Wiley & Sons], New York, 1975. MR 57:13703 

E. Noether. Invariante variationsprobleme. Gott. Nachr., pages 235—257, 1918. 
JFM 46.0770.01 

E. Noether. Invariant variation problems. Transport Theory Statist. Phys., l(3):186-207, 
1971. English translation of the original paper [13]. Zbl 0292.49008 MR 53:10538 

B. F. Plybon. New approach to the Noether theorems. J. Mathematical Phys., 12:57—60, 
1971. Zbl 0205.10902 MR 43:2591 

L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko. The math- 
ematical theory of optimal processes. Intersciencc Publishers John Wiley & Sons, Inc. New 
York-London, 1962. Zbl 0882.01027 MR 29:3316b 

M. A. Tavel. Milestones in mathematical physics: Noether's theorem. Transport Theory 
Statist. Phys., 1(3):183-185, 1971. Zbl 0291.49035 MR 53:10537 

D. F. M. Torres. A remarkable property of the dynamic optimization extremals. Investigacao 
Operacional, 22(2):253-263, 2002. 

D. F. M. Torres. Conservation laws in optimal control. In Dynamics, Bifurcations and Con- 
trol, volume 273 of Lecture Notes in Control and Information Sciences, pages 287-296. 
Springer-Verlag, Berlin, Heidelberg, 2002. Zbl pre01819752 MR 1901565 

D. F. M. Torres. Conserved quantities along the Pontryagin extremals of quasi-invariant 
optimal control problems. Proc. 10th Mediterranean Conference on Control and Automation 
- MED2002 (invited paper), 10 pp. (electronic), Lisbon, Portugal, July 9-12, 2002. 
D. F. M. Torres. On the Noether theorem for optimal control. European Journal of Control, 
8(l):56-63, 2002. 

Departamento de Matematica, Universidade de Aveiro, 3810-193 Aveiro, Portugal 
E-mail address: delfim0mat.ua.pt 
URL: http://www.mat.ua.pt/delfim 



